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1/^ (54) Title: ENERGY SENSING LIGHT EMITTING DIODE DISPLAY 
00 

^ (57) Abstract: A display that includes energy sensors within the display itself is disclosed- An Organic Light Emitting Diode 
^ (OLED) can be made to operate both as a light emitter and as an energy detector. When forward biased with an appropriate driving 
^2 signal, the OLED emits light via electroluminescence, which can be used to make a portion of an image on the display. In another 
mode, the OLED can detect energy by converting incoming photons or energy into an electrical signal by the photoelectric effect. By 
^ operating OLEDs in the display in both emissive and sensing modes, eneigy that shines on the display, such as from an outside source 
^ can be detected at the same time an image is shown. Additionally, a display including OLEDs can detect light enei^y generated by 
^ the display itself. 
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ENERGY SENSING LIGHT EMITTING DIODE DISPLAY 



5 TECHNICAL FIELD 

This disclosure relates to displays made from electroluminescent 
materials, and, more specifically to displays made from light einitting 
diodes that can emit light via electroluminescence, and can also sense 
light or other energy. 

10 

BACKGROUND 

There are several types of display devices available for producing 
text or images for viewing. Presently, the most prevalent display types are 
Cathode Ray Tubes (CRTs), which make up the majority of desktop 

15 displays and televisions, and Liquid Crystal Displays (LCDs), which make 
up the majority of displays of portable devices, such as laptop computers, 
telephones, and personal digital assistants (PDAs). 

Several other t3rpes of displays are not as well known, but are either 
available in limited quantities or are still being developed, such as plasma 

20 displays, Field Emission Displays (FEDs), Digital Light Processing (DLP) (a 
form of Micro Electro Mechanical Systems (MEMS)), Image Light 
Amplifiers (ILAs), and Light Emitting Diodes (LEDs). Each of these system 
types can generate displays for direct viewing, or can project an image on 
a surface for indirect viewing, 

25 Many of these typos of displays have problems with output 

uniformity from one picture element (pixel) to the others. For instance, in 
FED and LED systems, some individual pixels may generate more light for 
a given amount of driving signal than others. During the production of 
these displays, each pixel in the display is calibrated by individually 

30 lighting it and measuring the individual pixel's light intensity output. The 
measurements are compared to the output of the other pixels in the 
display. Adjustments are then made, such as by decreasing or increasing 
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the drive signal when displaying that pixel, i.e., triiiiming (calibrating) the 
display circuitry for driving the pixels. This calibration can be done for a 
single level of the driving signal, or the driving signal can be varied 
throughout the entire gamma curve so that the pixels are measured at 

. 5 different levels of input, from being fully off to being fully on. 
This uniformity test and calibration is typically done at 
manufacturing time, and the adjustments are usually permanently made. 
Therefore, if the output performance of the individual pixels changes over 
time, image quality of the display can degrade. 

10 Another problem that some displays have is maintaining overall 

correct display brightness for the amount of light in the room. For 
instance, when the room itself is brightly lit, the display must be bright as 
well to be seen above the ambient light. When the room is dimly lit, a 
bright display would be overpowering and difficult to view, unless the 

15 display is darkened. Some displays can automatically adjust their 

brightness level in response to other light in the room. They do this by 
including a photosensor to sense the ambient room light, and then adjust 
the brightness of the entire display based on the sensor output. One 
problem with this system is that the sensor may be in an unusually 

20 bright or dim area compared to the majority of the display, giving a 

reading that is inaccurate for the entire display. For instance the sensor 
may be in a shadow, while the majority of the screen is in bright light. 
Using multiple sensors in various locations of the screen may help the 
problem, but this solution increases the complexity and the cost of the 

25 display. None of the sensors can be directly in front of the display 

otherwise they would cover the display. Therefore, no matter how many 
photosensors are included around the display, none of the sensors are 
actually measuring Ught on the display itself, but rather only measure 
light around the display screen. 

30 Embodiments of the invention address these and other deficiencies 

in the prior art. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

Hie description may be best understood by reading the disclosure 
with reference to the accompanying drawings. 

FIG. 1 is a cross-sectional diagram showing the layers used to make 
5 an Organic Light Emitting Diode. 

FIG. 2 is a cross-sectional diagram showing additional layers that 
can be used to make the organic "layer" of FIG. 1. 

FIG. 3 is a diagram showing the operation of the photoelectric effect 
in solid state devices. 
10 FIG. 4 is a circiait diagram showing circuitry used in conjunction 

with embodiments of the invention. 

FIG. 5 is a circuit diagram showing additional circuitry used in 
conjunction with embodiments of the invention. 

FIG. 6 is a perspective view of an information display made 
15 according to embodiments of the invention. 

FIG. 7 is a front view of a display showing individual pixels in a 
display made from OLEDs according to embodiments of the invention. 

FIG. 8 is a front view of the display shown in FIG. 7 with a portion 
of the display covered by a shadow. 
20 FIG. 9 is a block diagram showing components that can be used to 

implement embodiments of the invention. 

FIG. 10 is a front view of the display shown in FIG. 7, showing a 
pixel in an emit mode, and several pixels in a sense mode, according to an 
embodiment of the invention. 
25 FIG. 1 1 is a block diagram showing components that can be used to 

implement embodiments of the invention. 

DETAILED DESCRIPTION 

Embodiments of the invention include a display made from LEDs, 
30 such as Organic LEDs (OLEDs) that can alternately produce visible light 
and measure light energy shining on the display. When forward biased by 
a voltage and injected with electron-hole pairs, the OLEDs emit photons 

3 
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that can be used to produce a display image. When the OLEDs are 
reverse biased, they act as photodiodes and can measure an amount of 
light energy sensed by them. The OLEDs can measure light falling on 
them from external sources from outside the display, or can measure light 
5 that is generated by neighboring OLEDs. Switching circuits alternate the 
OLEDs between an emit mode and a sense mode. 

OLEDs operate on a principle of converting electrical energy directly 
into light energy, a process termed electroluminescence. To produce 
electroluminescence in an OLED, first the OLED is forward biased by an 

10 external voltage. Then electrons and holes are injected into a special 

organic material selected for its ability to electroluminesce. The electrons 
and holes meet in the organic material and join together into an electron- 
hole pair ("pair''), and in so doing can generate a photon, thus producing 
light. When a matrix of OLEDs are grouped in a display, and individually 

15 driven, they can be used to form an image viewable on the display. 

FIG. 1 shows an example of an OLED 10. In its simplest form, the 
PLED 10 includes a cathode 12 for injecting electrons, an anode 14 for 
injecting holes, and a layer of organic material 20 where the electrons and 
holes can be combined. In many OLEDs 10, the anode 14 is transparent, 

20 or nearly transparent, so that light generated by the organic layer 20 can 
exit through the anode and be seen by a viewer. Also, generally, the 
cathode 12 is made from a reflective material, so that any photons that 
exit the organic layer 20 in the direction of the cathode are reflected off 
the cathode and back through the organic layer and out of the OLED 10, 

25 adding to the brightness of the display. 

The organic layer 20 may be made of several different layers, each 
optimized for a specific function. FIG. 2 shows an example of an OLED 
10 formed on a substrate 16, such as glass, where the organic material 20 
is formed of three layers. A layer 20A sits adjacent to the cathode 12, and 

30 is selected as an optimal electron transport layer. Similsirly, a layer 20C 
sits adjacent to the anode 14 and is selected for its ability to transport 
holes. A central layer 20B is optimized to produce photons from the 

4 
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electron-hole pairs. Although three distinct layers are shown in FIG. 2, 
each of the layers can in turn be formed from one or more layers of 
different materials. Therefore the organic layer 20 can be formed of any 
number of layers, in an effort to produce the best amount of photons in 
the OLED 10. To avoid confusion, the layer of organic material will be 
generically referred to as 20, unless distinction between the individual 
layers 20A, 20B, 20C is necessary. 

In addition to choosing an organic layer 20 that generates the best 
amount of photons, the material making the organic layer must be 
selected to generate photons of a certain color. Typically a display is 
made of tiny adjacent pixel areas where one area produces a red signal 
(red pixel), one area a green signal (green pixel), and one area a blue 
signal (blue pixel). Oftentimes this is called an RGB display, for Red, 
Green and Blue. A typical display has three different OLEDs adjacent to 
15 one another, each having an organic layer 20 that produces either red, 
green or blue photons, respectively. Some OLEDs are formed from a 
stack of several organic layers 20, and use transparent cathodes 12 and 
anodes 14 so that all three colors can be generated in the same physical 
pixel area. These OLEDs are called Stacked OLEDs (SOLEDs), and can 
20 produce very fme detail because they have three times the density of non- 
stacked OLEDs. Typical displays for laptop computers have 1024 column 
pixels and 768 row pixels for each of the three colors red, green and blue. 
An advantage to using SOLEDs for these displays is that only 1024 x 768 
pixels are used, and not three times that amount, because each of the 
25 pixels in a SOLED display is capable of producing a signal in red, green 
and blue at the same time. Managing the output of each of the different 
colored OLEDs so that an overaU \uiiform image is produced is a difficult 
task, for all types of OI^Ds. 

As mentioned above, to generate photons from the organic layer 20, 
the OLED 10 must be under forward bias, i.e., a positive voltage is appUed 
between the anode 12 and the cathode 14. An interesting phenomenon 



30 
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occurs when an OLED 10 is not biased, or under reverse bias; it becomes 
a photodiode, or photodetector. 

FIG. 3 illustrates photodetection in a solid state device. In FIG. 3 
only the organic layer 20 portion of the OLED 10 is shown. The organic 

5 layer 20 in FIG. 3 is divided into different separate regions, 22, 24, 26, 
but, even though they may be similar, these regions do not necessarily 
correspond to the layers 20A, 20B and 20C of FIG. 2. The region 22 
(electron region) has an excess of electron carriers and the region 26 (hole 
region) has an excess of hole carriers. Between the electron region 22 and 

10 hole region 26 is a space charge depletion region (SCDR) 24. The SCDR 
24 has a built in electric field, which begins at the electron region 22 and 
extends to the hole region 26. 

When a photon (light energy) enters the SCDR 24 having an energy 
level at least as large as a bandgap voltage of the organic layer 20, the 

15 photon can create an electron-hole pair 30, which is made of an electron 
32 and a hole 36. Because the electron 32 has a negative charge, and the 
hole 36 has a positive charge, they are both immediately swept out of the 
SCDR 24 in opposite directions, due to the presence of the electric field. 
The electron 32 is swept into the electron region 22 and the hole 36 is 

20 swept into the hole region 26. If a circuit is made between the electron 
region 22 and the hole region 26, this sweeping action can cause a 
current (photocurrent) to flow between these regions. 

The photodiode of FIG. 3 may operate even with zero outside bias. 
But because the SCDR 24 increases in width when under reverse bias, 

25 and because more photons land on the SCDR the wider it is, the OLED 10 
is more sensitive to light and a better photon detector when the OLED is 
reverse biased. Therefore, the OLEDs 10 are usually reverse biased when 
they are in the light sensing mode. A sense driving circuit for applying 
reverse bias and measuring light energy falling on an OLED 10 is shown 

30 in FIG. 4, and generally indicated at 40. In that figure, the OLED 10 is 
reverse biased by a positive voltage applied at a front terminal 42. In one 
embodiment, the reverse bias appUed to the OLED 10 is a dc voltage 

6 
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having a level approximately between 0 and 10 volts, dc. The reverse bias 
is generated by a sensing biasing circuit 50, which is coupled to the front 
terminal 42. A rear terminal 44 is coupled to output sensing circuitry 60, 
which could include e.g., a sense amplifier used to amplify the 
5 photocurrent generated by the OLED sensing light. The sensing circuitry 
60 has an intensity output terminal 66, where an output varies based on 
the amount of light energy hitting the OLED 10. 

When light energy (indicated by wavy arrows) falls on the OLED 10, 
current flows from the rear terminal 44, which is sensed and measured by 
10 the sensing circuitry 60 and output at the intensity terminal 66. The 
output at the intensity terminal 66 indicates how much light is falling on 
the OLED 10. 

Each OLED 10 may have its own biasing circuit 50 and sensing 
circuitry 60, or many OLEDs can share the same biasing and sensing 
15 circuits. By having the same biasing 50 and sensing 60 circuits drive a 
series of OLEDs 10, vi^hich is called multiplexing, a display can be more 
economical to build because by sharing circuits, fewer need be included 
in the display. 

The light energy that the OLEDs 10 sense can be light from any 
20 source, internal to a display or external from it. For instance, the light 
may be ambient light in the room that is sensed by the OLEDs 10, and 
the signal generated from sensing it used to brighten or dim the entire 
display accordingly. Or, the light sensed may come from a light pen or 
laser pointer that is pointed at a screen made of OLEDs 10. Further, the 
25 OLEDs 10 can sense light emitted by other OLEDs. By having the OLEDs 
10 be in a sense mode for at least a short time period during a time a 
display is operating, the OLEDs 10 can be generating a portion of the 
display in one moment, then be sensing light in another. 

Just as light that is emitted from an OLED has a certain spectral 
30 characteristics, light that is sensed by the OLED also has spectral 

characteristics. In order to be sensed by an OLED, the photon hitting the 
SCDR 24 (FIG. 3) must have energy equal to or in some cases greater 

7 
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than the bandgap voltage of the material composing the organic layer 20. 
Because different materials are used for ihe organic layers 20, in order to 
produce a red, green, and blue signal, the spectrum sensitivily of these 
materials may not be identical, and most likely probably would not be the 
5 same as one another. Optimization of the selection and operation of the 
organic material layer 20 to achieve the best emitting and sensing 
characteristics is best performed by the implementer of a system that 
uses sensing and emitting OLEDs. 

In addition to sensing light that is shining from outside a display, 
10 the OLEDs 10 can also sense light that is within the display itself, i.e., 
Ught that is generated by other OLEDs. As mentioned above, many of the 
photons produced within the organic layer 20 (FIG. 1) do not exit the 
OLED 10, but are rather self-extinguished in the organic layer, or exit the 
OLED 10 in a direction other than out from the display to the viewer. In 
15 some displays only about 1 /3 of the total generated Ught is actually 

presented to the user, with the rest being self-absorbed or emitting in the 
direction of a neighboring OLED 10. 

Although the OLEDs 10 cannot be in both the emitting mode and 
sensing mode simultaneously, the OLEDs 10 adjacent to an emitting 
20 OLED can be in sensing mode. In this way, the OLEDs 10 can actively 
sense an amount of light generated by a neighboring OLED, as the 
neighboring OLED is generating Ught. AppUcation of these unique 
properties is discussed below. 

FIG. 5 shows how the sense driving circuitry 40 can be easily 
25 modified to also incorporate forward driving circuitry, to make a complete 
emitting and sensing driving circuit 70 for an OLED 10. In addition to the 
components present in the sense driving circuit 40, the complete emitting 
and sensing driving circuit 70 includes a forward driving circuit 74 
coupled to the rear terminal 44. AdditionaUy, a pair of switches 76, 78 is 
30 coupled to the OLED 10 to connect the OLED to the proper emitting or 
sensing circuitry at the correct time. The forward driving circuit 74 
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provides a driving current to the OLED 10 to cause it to emit photons. As 
more current is provided, more photons are emitted by the OLED 10. 

During forward operation, i.e., when the OLED is in emit mode, the 
switch 76 couples the forward driving circuit 74 to the rear terminal 44; 
5 and the switch 78 couples the front terminal 74 to a ground or other 
reference voltage. When the OLED 10 is connected in this way and when 
the forward driving circuit 74 is generating a signal that causes the OLED 
to produce photons, the OLED generates Ught and can be made as a part 
of a display. 

10 As mentioned above, the signal generated by the forward driving 

circuit 74 controls the Ught output of the OLED 10 to which it is 
connected. Therefore, the signal presented to the forward driving circuit 
74 is an emissive intensity level. By controlling the emissive intensity 
levels for all of the pixels that make up a display, an image can be made 
15 that is seen by a viewer. Each of the different colors of OLEDs 1 0 will 
have their own emissive intensity levels to produce the same brightness 
level of output. Therefore, one solution in a display is to have a different 
' set of forward driving circuitry 74 for each of the different colors of OLEDs 
10. In other words, in those embodiments, at a minimum one set of 
20 forward driving circuitry 74 for each color, red, green, and blue must be 
included in the display. 

During reverse operation (sense mode), the switch 76 couples the 
rear terminal 44 to the sensing circuitry 60, and the switch 78 couples 
the front terminal 42 to the sensing biasing circuit 50, forming a circuit 
similar to that shown in FIG. 4. As mentioned above, the sensing biasing 
circmt 50 reverse biases the OLED 10 anywhere from about 0 volts to 
about 10 volts, dc. During operation when the OLED 10 is connected in 
this mode, the OLED senses Ught energy falling on it. As mentioned 
above, the light energy sensed by the OLED 10 can be from an external 
source, i.e. from a source outside a display, or can be from another source 
inside the display itself, i,e. from another OLED. 



25 
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The switches 76, 78 can operate very quickly to change the OLED 
10 from emitting to sensing mode veiy fast. The physical s>»itching time 
of the OLED 10, which is related to the physical parameters of the organic 
material layer 20 (FIG. 1) is on the order of a few nanoseconds. Therefore, 
it is possible that the switches 76, 78 can be switched thousands or even 
millions of times per second. If the same emitting and sensing circuitry 
70 is driving a large group of OLEDs 10, parasitic capacitance issues may 
prevent the emitting and sensing circuitry from changing that fast. 

The duty cycle of the OLED 10, which is the time the OLED is in 
emit mode compared to the entire operating time of the OLED, need not 
be 50%. Nothing prevents the OLED 10 from having a non-equal duly 
cycle between the emit mode and sense mode. For instance, having the 
emit mode only operative 50% of the time, as would be the case if there 
were an equal duty cycle between the emit and sense modes, may produce 
15 a display less bright than desired. Depending on what function the 

sensing mode is being used for in a display, the OLED 10 may be in the 
emit mode from 100 to 6 percent of the time, while being in sensing mode 
from 0 to 100 percent of the time. Additionally, not all of the OLEDs 10 in 
a display need to be in the same mode at the same time. For instance, 
20 there may be an average of 1 in 20 LEDs in the sense mode, reading Ught 
that is shining on a computer monitor while the other 19 are in emit 
mode. 

As described with reference to FIG. 5, the forward driving circuit 74 
can actually drive more than one OLED 10, by multiplexing the driving 
drcuit to drive many OLEDs that operate at different times. Multiplexing 
is a way to save costs that is fairly easy to implement and does not cause 
any appreciable loss in image quality. 

One way of making a display device from a series of OLEDs 10 is 
illustrated in FIG. 6. In that figure, a display 100 is shown, which 
includes cathodes 112, anodes 114, and an organic layer or layers 120. 
In the display 100 of FIG. 6, the anodes 114 are fairly narrow and evenly 
spaced apart in a first direction, and afBxed to a see-through substrate 

10 
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1 16, such as glass. The cathodes 1 12 are also fairly narrow and evenly 
spaced apart, but they are placed in a direction perpendicular to the 
direction of the anodes 1 14. The end product is the display 100 that has 
a separate diode 110 at every junction between a cathode 112 and an 
anode 114. If there are twenty cathodes 112 and twenty anodes 114 in 
the display 100, then there would be four-hundred diodes 1 10 in the 
display. With Uttle modification and using techniques well known in the 
art, the display 100 could be made as either a passive type display or an 
active type display, a difference being the presence of individual 
transistors and energy storage devices used for each pixel in the active 
type display. 

FIG. 7 shows a front view of a display 130 made according to 
embodiments of the invention. The display 130 has 48 total diodes 1 10, 
arranged in an 8x6 matrix, with rows labeled A-F and columns labeled 1- 
8. In practice, there would be many more diodes 1 10 in the display 130, 
of course, and they be so close that they were nearly indistinguishable 
from one another, lonless the display was viewed under magnification. 

Each of the diodes 110 in the display 130 is capable of operating in 
either the emit mode or the sense mode. As mentioned above, the 
emitting and driving circuitry 70 can be multiplexed to drive several of the 
diodes 1 10. One method of multiplexed driving is to simultaneously drive 
all of the diodes 1 10 in a single row, and then sequentially drive all of the 
rows making up the display 130, one row at a time. For instance, to 
create an image on the display 130, the emitting circuitry 40 could first 
drive all the diodes 110 in row A. After driving those diodes 110, the 
emitting circuitry would switch and drive all the diodes in row B. This 
would continue through the rows A-F until all of the rows have been 
driven, and the image generated on the display 130. The changing 
between the rows A-F happens so fast that the viewer of the image in the 
I display 130 woxild not detect any switching or strobing of the rows, and 
instead the image appears as a constant image on the display. 



11 
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By making a display 130 having diodes 1 10 that can both emit and 
sense light, functions to monitor the output of the display, even during 
the operation of the display, are achievable. In the following discussion of 
operational functions of the display 130, it is assumed that each diode 

5 110 can be individually controlled to be in either the emit state, the sense 
state, or an off state where it is neither emitting nor sensing. Therefore, 
instead of a display 130 built as shown in FIG. 6, with all of the cathodes 
1 12 in a row (or column) connected and all of the anodes 1 14 in a colxmm 
(or row) connected, it is assumed that both the cathode 112 and the 

10 anode 1 14 are separate, allowing individual control of all of the diodes 
.1 10, as schematically shown in FIG. 5. 

Sensiag brightness from ambient light 

By making a display 130 from diodes 1 10 that can both emit and 

15 sense light, the brightness of each of the diodes in the display can be 

individually controlled. In such a mode at least some of the diodes 110 of 
the display 130 toggle between their emit and sense states, or some of the 
diodes 110 remain in their sense states. The number of diodes 110 in the 
sensing state is determined by a number of factors, including, for 

20 instance, the energy sensing sensitivity of the individual diodes, and 
where in the display 130 the sensing diodes are placed, etc. In the 
sensing ambient light mode, the diodes 110 turn on for a time period in 
their emit mode to make their portion of the image on the display 130. 
Then the diodes 110 switch to their sense state and sense ambient light 

25 falling on the display 130. In their sense state, each of the diodes 110 
quantifies the amount of light falling on it. When the diodes 110 change 
again back to their emit state, they use the quantified information of how 
much light is/was striking them in the present or in the previous sense 
state to control the current brightness of the individual diode. In other 

30 words, when the diodes 1 10 sense more light energy shining on them 
than in a previous cycle, or they sense more light energy shining on them 
than other diodes 110 in the present cycle, or when the sense an amount 
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of light more than a permanently stored value, more driving current is 
supplied to those particular diodes to make the diodes shine brighter. 
Conversely, if the diodes 110 have less light energy shining on them than 
those diodes around them, or have less light energy than they did in a 
5 previous cjrcle, or measure less light than a previously stored value, less 
current is applied to those diodes, and they will shine less brightly in the 
present cycle. 

For an example to illustrate this mode, consider a shadow 140 
covering a portion of the display 130, as shown in FIG. 8. Those of the 

10 diodes 110 that are completely in the shadow 140 (E8, F7-8) would sense 
less light energy than those diodes around them or than when the shadow 
was not present. Those diodes that are partially in the shadow 140 (D8, 
E7, F6) would also sense an amount of light energy between those diodes 
110 that were completely out of the shadow 140, and those that were 

15 completely in it. Data of the reduced light energy is fed back to the 
emitting and sensing driving circuitry 70, which would in turn 
proportionally decrease the emission current output to those cells that . 
' were either partially or fiilly in the shadow, making them shine less 
brightly. Those diodes 110 outside of the shadow 140 would continue to 

20 be driven by the same energy as before the shadow was present. The 

result is a display 130, partially occluded by a shadow 140, but appearing 
to the viewer as one having constant brightness across the entire display. 

Another example (not shown in FIG. 8) is a display 130 that has a 
flashlight shining a beam on a portion of the display. When each of the 

25 diodes 1 10 that are under the flashlight beam detects that they are in a 
lighted area, it signals the presence of the light energy to the emitting and 
sensing driving circuitry 70, which automatically increases its light 
output to compensate for the flashlight beam. The other diodes 110 
remain at the same brightness output as before. Again, similar to where 

30 the display 130 is partially blocked by a shadow, 140, the viewer sees 
uniform brightness across the entire display. By switching qiiickly 
enough between the emit and sense states, the display 130 can self- 
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correct brightness conditions in real time. Therefore, no change in 
brightness of the display 130 would be detected, even as the flashlight 
beam sweeps across the display. 

For embodiments of this mode, it is not necessary that every diode 
5 110 switch between the emit mode and the sense mode. For example the 
display 130 may be set up so that some diodes 1 10 that are spread over 
different areas of the screen are always in the sense mode, while other 
diodes are never in the sense mode. This would be akin to having 
photodiodes placed all about the screen, but not interfering with the 

10 image showing on the display 130. As few as one diode 110 or as many 
as all of the diodes 1 10 of the display 130 can be used to sense the 
ambient light during some time of the duty cycle of the diodes, with the 
signal received from the sensing diodes being used by the emitting and 
sensing driving circuitry 70 to modulate the emission signal of all of the 

15 emitting diodes. 

An example system that could implement such a display mode as 
describe above is shown in FIG. 9. The display 130 has different amounts 
of light, or other detectable energy 220 shining on different portions of it. 
The amount of energy sensed is fed back to a feedback controller 210, 

20 which accesses data from the previous cycles stored in a memory or 

storage 212, and interfaces with one or more compensation processes or 
tables 216. The feedback controller 210 determines how much to adjust 
the driving energy applied to the forward driving circuitry 74, if any, and 
provides that signal to the driving circuitry. The forward driving circuitry 

25 74 then drives the diodes 110 with the proper current to produce the 
proper amount of intensity for the generated image. 

In more detail, at least one of the diodes 110 (not shown 
individually) that makes up the display 130 senses the amount of light 
220 shining on it. The sensed light information is measured by the 

30 sensing circuitry 60, which is a part of the emitting and sensing driving 
circuitry 70 (FIQs. 4 and 5), and is fed to the light energy feedback 
controller 210. The feedback controller 210 is coupled to the diode energy 

14 
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data storage 212, which is divided into four sections. A first section 212A 
stores the amount of energy received by the diodes 110 in the previous 
cycle, and may include historical data for several cycles. A second section 
212B stores the amount of energy received by the diodes in the current 
5 cycle. A section 212C stores an indication of the amoimt of driving 

current applied to the diodes 1 10 in the previous cycle, which again may 
include several previous cycles of data. A section 212D stores an 
indication of an amount of current to be supplied to the diodes in the 
present cycle. 

10 The feedback controller 210 accesses whatever infonnation is 

needed from the data storage 212, and communicates with any necessary 
compensation tables 216 to determine the correct amount of driving 
current to supply to the diodes 110 to compensate for any outside 
influence. Of course, the compensation tables 216 need not be tables at 

15 all, and could be a process that runs a function based on input provided 
by the feedback controller 210, and provides the function output in 
return. 

For example, to sense ambient light, the diodes that are in the 
sense mode supply the amount of sensed light 220 to the feedback 

20 controller 210. The feedback controller can retrieve the amount of light 
220 sensed in previous cycles from the section 212A, or it may compare 
the amount of light sensed with the other diodes 1 10 on the display 130, 
or may even compare that amount with a set of permanently stored 
values. The feedback controller then communicates with the 

25 compensation tables 216 to determine the new level of current for driving 
the diodes, then communicates the new level to the data storage 212, to 
be stored in the section 21 2D, and to the forward driving circuitry 74 to 
be applied to the individual pixel. In this way, any number of pixels in 
the display 130 can sense an amount of ambient light, which may be 

30 applied to a representative group, or individually to each of the pixels in 
the display. 



15 
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Uniformity calibration of pixel brightness 

A mode related to the above mode is that diodes 1 10 in the display 
130 can be used to help calibrate the individual brightness response of 
other diodes 1 10 from a standard driving current. As mentioned above, 

5 due to a variety of factors, individual OLEDs 10 can produce differing 
amounts of brightness even when they are driven by the same amount of 
driving current. A display 130, which is made from diodes 110 that can 
both emit and sense light, can compensate for these individual 
differences, either when the display 130 is being manufactured, or during 

10 the operation of the display 130. 

When the display 130 is being manufactured, a uniformity 
calibration can be performed by measuring the output of each of the 
individual diodes 110, and normalizing them against one another. For 
instance, the display 130 can be controlled to set a diode 110 in its emit 

15 mode, and set neighboring diodes in their sense mode. FIG. 10 shows a 
diode 110 at location D3 being tested. In this example, the diode 110 at 
D3 is in its emit mode, while others around it (Al, B2-4, C2-4, Dl-2, D4- 
5, E2-4, and F2-4) are set in their sense mode. If the display 130 
included an additional row, then diode 1 10 at F3 would also be in its 

20 sense mode. Of course, any number of diodes 110 may be used in the 
sense mode, and not only those shown in FIG. 8B. External light shining 
on the display 130 may be minimized by performing the test in a 
darkened condition, or other techniques used to ensure that a uniform 
amount of light is showing on the display, as non-uniform lighting may 

25 skew the uniformity test. 

The diode 1 10 at D3 is lit by driving it with an emitting signal as 
described with reference to FIG. 5, and the surrounding diodes (Al, B2-4, 
C2-4, Dl-2, D4-5, E2-4, and F2-4) measure the amount of light internally 
generated by the lit diode D3. The results may be recorded for later 

30 changes, or the diodes 1 10 can be adjusted in real-time by having the 
diodes in sense mode feedback their information through the forward 
driving circuit 74 (FIG. 5). 
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If the data is recorded for the brightness characteristics of each 
diode 110, then once the performance data for the first diode is recorded 
the display 130 puts another diode 110 in emit mode, e.g., D4. The 
diodes in an area around the diode D4 then similarly change to the sense 
5 mode, auid the test is repeated. This procedure continues until all of the 
diodes 110 of the display 130 have been measured, and possibly until 
they have been measured multiple times and under different conditions. 
Another way to check the brightness of all of the diodes 1 10 is to light all 
of the diodes in one row simultaneously, set the diodes in adjacent rows 

10 to the sense mode, and read the amount of light sensed by rows of diodes 
above and below the lit row. Except for the diodes 110 near the end of the 
rows, the brightness should be relatively uniform for each of the sensing 
pixels in the middle of the rows. 

Once the diodes 1 10 of the display 130 have been measured, 

15 adjustments can be made to the diodes to normalize their output to one 
another, such as by changing their driving current, or applied driving 
current, etc. Another embodiment may store an indicator of the 
brightness of each diode 110, and later when the diode 1 10 is in its emit 
mode, modify its driving current by consulting the stored indication of its 

20 previous brightness score, 

A combination of the above two modes could include performing a 
normalizing brightness test on each of the diodes 1 10 in the display 130, 
and initially set each diode accordingly. Later, as the brightness of the 
diodes 110 chamge over time, e.g., as the display 130 ages, the diodes in 

25 their sensing mode can automatically correct for changes in brightness by 
using the techniques described above. In this way, embodiments of the 
invention are capable of performing both an initial brightness calibration, 
such as one done at manufacture, and/ or a self-calibration, such as one 
performed periodically, and/ or even still as a continuing brightness 

30 calibration, in real-time as the display 130 is operated. 

The system shown in FIG. 9 could be used to implement the 
brightness calibration mode. In operation it functions similar to sensing 
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ambient light, described in the above section, but instead, in this case the 
light is generated by the diodes themselves. Previous data of the 
brightness intensity is stored in the memory 212A, which is accessed by 
the feedback controller 210. The feedback controller 210 determines what 
5 that proper driving signal should be with the help of the compensation 
tables 216, and sends that signal to the forward driving circuitry 74, and 
may send the data to be stored in the section 212D of the memory 212 as 
well. 

10 Gamma uniformity calibration of pixels 

Embodiments of the invention are additionally able to perform a 
gamma uniformity of the diodes 110 of the display 130 based on the 
actual gamma response of the individual diodes. This mode is similar to 
the brightness uniformity of the individual diodes 110 described above, 

15 and could be implemented in a similar way where one or more diodes are 
tested while others measure their performance. One difference, however, 
is that measurements of the output of the diodes 1 10 is made for output 
of the diodes from full dark to full bright (the "gamma curve'' or "general 
transfer function'' of driving current to brightness output). The 

20 measurements can be made in a relatively few points along the curve, or 
they can be made at many points along the curve. The "gamma numbers" 
may be used only once when the display is being manufactured to 
permanently modify the gamma curve for the individual diodes 110, or 
they may be stored in the display 130 for later updating. Similar to the 

25 brightness test described above, embodiments of the invention are 
capable of performing both an initial gamma calibration, such as at 
manufacture, or a self-calibration, such as one performed periodically, or 
even still as a continuing gamma calibration, in real-time as the display 
130 is operated. 

30 A gamma uniformity test could be a portion of a self test performed 

when a user powers the display 130, whereby the gamma numbers that 
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were stored previously were are updated, or the ga mm a uniformity test 
could be performed upon request of the user. 

The system shown in FIG. 9 could also be used to implement the 
gamma uniformity mode, similar to the way the brightness uniformity 

5 mode is implement. One difference would be that the memory 212 could 
store data points along the gamma curve for each of the diodes 110, and 
not just a single bri^tness number. Another difference would be the 
tables or functions that the feedback controller 212 would communicate 
with in the compensation tables 216. As above, once the new driving 

10 signals were determined, they would be sent to the forward driving 
circuitry 74 to drive the diode 110, and also stored in the data storage 
212. 



Sensing an external pointing device 

15 A further possibility of use for the display 130 is that it could be 

used to sense the position of a laser or other type of external pointing 
device, and even possibly integrate the response of; the pointing device 
with operations performed on the display. As shown above, the display 
130 can sense when light energy is striking the display, in real time, 

20 Also, by determining which of the pixels are sensing energy, the position 
of the energy on the display 130 can be determined. Therefore, an 
application of this feature can detect the presence and position of a 
pointing device, and, once the presence and position is known, could even 
£illow the movements of the pointing device shining on the screen to 

25 control the output of the display 130. 

A system that could implement this mode is illustrated in FIG. 1 1. 
In that system, the display 130 has a laser pointer 250 or other energy 
source shining on the display. The location of where the pointer 250 is 
pointing on the screen and any action taken by the pointer, such as 

30 clicking or double-clicking, is determined by a pointer position interface 
252. The positional and action information is forwarded to an image 
generator 260, which can utilize the actions as input to determine which 
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image to show next. Once determined, the image generator sends the 
image data to the forward driving circuitry 74 to drive the diodes 1 10 (not 
individually shown in FIG. 11) of the screen 130 to make the displayed 
image. 

5 In one embodiment, the movement of the pointer 250 could simply 

be substituted for the input of a computer mouse. Pointing action is 
performed by tracking where the pointing device is currently positioned 
on the display 130 by sensing the light energy by having several or all of 
the diodes 110 in the display be in sensing mode at some time. A clicking 

10 action could also be sensed by detecting a pulse of light from the pointer, 
or perhaps a different frequency pointer (different color) could provide the 
distinction between a clicking action and a non-clicldng one, for example. 
It is possible that all of the diodes 1 10 of the display 130 be in sensing 
mode during times they are not emitting light. For example, if only one 

15 row of diodes 1 10 is being driven to emit light at a particular instant, the 
other rows, which would otherwise be in an idle mode or turned off, could 
be in the sense mode. 

In operation, the pointer could select objects being displayed on the 
display 130, such as a presentation having "next" arrows, or a Hyper Text 

20 Markup Language (HTML) page being shovra. Clicking on a portion of the 
HTML page could cause other HTML pages or images to be shown on the 
device 130. 

In more detail, the system shown in FIG. 11 includes a pointer 
position locator 254 coupled to the pointer position interface. Additionally 

25 coupled to the pointer interface is a sensed energy data storage 256, 

which is used to store energy data sensed by the diodes 1 10 of the display 
in the previous cycle or cycles. The location where the pointer 250 is 
pointing could be determined by comparing the sensed energy from the 
diodes 110 to one another, or by comparing them to the energy sensed by 

30 the diodes in a previous sensing cycle. Because the pointer 250, 
especially if it is a laser pointer, is very focused and bright, an exact 
position on the screen should be straightforward to calculate based on the 

20 
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amount of Ught energy sensed by the diodes in sensing mode. Also, the 
pointer position interface could calculate a pointer action, similar to a 
mouse cUck, by detecting a pulsed pointer, or a pointer switched to 
another color, which may affect the amount of energy sensed by the 
diodes 110. 

The position and state of the pointer 250 is passed to the image 
generator 260 as a form of input. The image generator can then 
determine which image to show next, and communicate with an image 
storage controUer 262 to select the proper image. An image repository 
268 is coupled to the image storage controller and stores a number of 
frames to be displayed. As an example, assume the display 130 is 
showing a power point presentation that has a forward arrow to select the 
next slide, and a back arrow to select another slide. The pointer 250 
clicks on the back arrow, which is sensed by the pointer position interface 
and sent to the image generator 260. The image generator knows to go 
back to the most recently shown frame, and directs the image storage 
controller to select that frame from the frame repository 268. Once 
selected, the image data is sent back to the image generator, which 
formats it and sends the proper signals to the forward driving circuitry 74 
to drive the diodes 1 10 with the signals to create the desired image. 

Although the above examples described the display 130 detecting 
an external Ught signal, such as from the light pointer 250, the display is 
equally effective at detecting an external shadow. For instance, the 
display 130 could detect a shadow made by an operator's finger, thereby 
having function similar to a touch screen. 

Electronic white board 

A display 130 such as described herein could be a component of an 
electronic display screen, operating in much the same way as for 
detecting a pointing device above. In this operation, Ught generated from 
a Ught pen, or other device, is sensed by the diodes 1 10 of the display 
130. Input sensed by the display 130 is immediately sent to the pointer 

21 
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position interface 252 that reads the input, and sends that input to the 
image generator 260. The image generator determines an image to show 
and sends the image to the roward driving circuitry 74 to show the image 
on the display 130. For example, if a viewer "wrote'' the letters INTEL® on 

5 a display 130 using a light pen, the display could show the same letters 
display, as it is being written. In a related embodiment, the display 130 
could sense different "colors'' of light pens, such as, for example, by 
assigning a certain frequency or intensity to a particular color of pen, 
then associating the particular sensed pen with a color previously stored 

10 in the image generator 260. Then, the associated color is shown on the 
display 130 in the areas where that particular color was used as input to 
the display. 

By creating display that can simultaneously emit an image in one 

15 portion while detecting energy input to the display at another portion, or 
that can switch between emitting and sensing modes quickly enough to 
avoid detection, tremendous possibilities for use exist. In effect, such a 
' display becomes both an input and an output device, where images can 
be outputted to a viewer, but where the viewer can also interact with the 

20 display as an input. Any form of energy that is capable of being sensed by 
the display as disclosed above can be used as an input to the system that 
is coupled to the display. OLEDs may be capable of emitting only a 
narrow bandwidth of light, but be able to sense a much larger bandwidth. 
Although examples of displays made from OLEDs have been 

25 discussed above, nothing prevents embodiments of this invention to work 
with other types of LEDs, for example those made with inorganic 
semiconductor material such as Silicon or Gallium- Arsenide. Any diode 
that is capable of emitting photons in one mode and sensing energy in a 
second mode can be incorporated into embodiments of the invention. 

30 Implementation of the display that can emit and sense photons is 

straightforward to implement in light of the above disclosure. As always, 
implementation details are left to the system designer. The circuits used 

22 
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to drive the diodes in the display may be implemented in any way, with 
any components as long as they can cause the diodes to perform the 
necessary functions in the display. One particular optimization that may 
be best determined empirically is the duty cycle of the diodes between the 
emitting mode and the sensing mode. Having the diodes spend the 
majority of a duty cycle in the emitting mode may yield better display 
efficiencies, while having the diodes spend the majority of the duty cycle 
in the sensing mode may yield better energy detecting efQciencies. 

Thus, although particular embodiments for a display including an 
energy sensing diode has been discussed, it is not intended that such 
specific references be considered as limitations upon the scope of this 
invention, but rather the scope is determined by the following claims and 
their equivalents. 
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WHAT IS CLAIMED IS: 

1. A display system, comprising: 

a plurality of light Emitting Diodes (LEDs) forming a display panel, 
5 at least some of the LEDs of the display panel operable in an emit mode, 
and at least some of the LEDs of the display panel operable in a sense 
mode; 

a driving circuit adapted to couple to one of the plurality of LEDs 
operable in the emit mode and structured to cause the one of the plurality 
10 of LEDs operable in the emit mode to emit light; and 

a sensing circuit adapted to couple to one of the pltirality of LEDs 
operable in the sense mode and structured to cause the one of the 
plurality of LEDs operable in the sense mode to sense light energy. 

15 2. The display system of claim 1 wherein at least some of the 

plurality of LEDs of the display are operable in the emit mode and in the 
sense mode. 

3. The display system of claim 1 wherein one or more of the 
20 plurality of LEDs comprises an organic material. 

4. The display system of claim 1 wherein the sensing circuit 
comprises a reverse bias circuit coupled to the one of the plurality of 
LEDs operable in the sense mode. 

25 

5. The display system of claim 1 wherein the sensing circuit is 
structured to sense an amount of light energy received by the one of the 
plurality of LEDs operable in sense mode. 

30 6. The display system of claim 1 wherein the sensing circuit is 

structured to sense an amount of light energy generated from outside the 
display panel. 

24 
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7. The display system of claim 1 wherein the sensing circuit is 
coupled to a first LED, and wherein the sensing circuit comprises: 

a reverse biasing circuit coupled to a first terminal of the jfirst 

5 LED; and 

a sensing circuit coupled to a second terminal of the first 

LED. 

8. The display system of claim 7 wherein the sensing circuit 
10 comprises a sense amplifier. 

9. The display system of claim 1 wherein the driving circuit is 
adapted to be coupled to a first group of LEDs operable in the emit mode 

15 while not being coupled to a second group of LEDs operable in the emit 
mode. 

f 

10. The display system of claim 9 wherein the first group of LEDs 
are all in a same row of the display panel. 

20 

11. The display system of claim 1 wherein the driving circuit is 
adapted to be coupled to a row of LEDs operable in the emit mode while 
the sensing circuit is adapted to be coupled to a row of LEDs operable in 
the emit mode, the row of LEDs operable in the emit mode adjacent to the 

25 row of LEDs operable in the sense mode. 

12. The display system of claim 1, further comprising: 

an LED brightness adjusting circuit coupled to both the sensing 
circuit and the driving circuit, and configured to modulate a brightness of 
30 an output of an LED in the display panel operable in the emit mode based 
on a signal received from an LED in the display panel operable in the 
sense mode. 

25 
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13. The display system of claim 12 wherein the LED of the 
display panel operable in the sense mode is configured to sense light from 
a source external to the display panel. 

5 

14. The display system of claim 12 wherein the LED of the 
display panel operable in the sense mode is configured to sense light from 
the LED in the display panel operable in the emit mode. 

10 15. The display system of claim 1, further comprising: 

a uniformity calibration circuit coupled to both the sensing circuit 
and the driving circuit, and configured to adjust the output of an LED in 
the display panel operable in the emit mode based on the output of 
another LED in the display panel operable in the emit mode that is sensed 

15 by an LED in the display operable in the sense mode. 

16. The display system of claim 15 wherein the uniformity 
calibration circuit is a gamma uniformity calibration circuit and is 
operable to adjust the output of the LED in the display panel operable in 

20 the emit mode over a range of output intensities. 

17. The display system of claim 1, further comprising: 

a position circuit coupled to the sensing circuit and structured to 
determine a position on the display panel at which an external light 
25 source is pointing. 

18. The display system of claim 17 wherein the positional circuit 
is configured to compare outputs of one or more LEDs in the display 
panel operable in the sense mode. 

30 
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19, The display system of claim 17, further comprising an image 
generator coupled to the position circuit, the im^e generator structured 
to generate an image responsive to an output from the position circuit. 

5 20. The display system of claim 1 wherein one or more of the 

plurality of LEDs are Stacked Organic Light Emitting Diodes (SOLED). 

2 1 . The display system of claim 1 wherein one or more of the 
LEDs of the display panel operable in the sense mode are Stacked Organic 

10 Light Emitting Diodes (SOLEDs). 

22. The display system of claim 21, wherein the sensing circuit 
comprises a plurality of separate layer sensing circuits respectively 
coupled to separate organic layers in the one or more SOLEDs, and 

15 wherein the sensing circuit is structured to signal from which of the 

separate organic layers in the one or more SOLEDs light energy is being 
sensed. 



23. An electroluminescent display device, comprising: 
20 a first plurality of diodes capable of producing an 

electroluminescent output; 

a second plurality of diodes capable of sensing light energy that is 
directed on them; 

a forward driving circuit adapted to couple a first terminal of one of 
25 the first plurality of diodes, the forward driving circuit structured to cause 
the one of the first plurality of diodes to produce the electroluminescent 
output; 

a biasing circuit coupled to a first terminal of one of the second 
plurality of diodes, the biasing circuit structured to cause the one of the 
30 second plurality of diodes to be in a sense mode; and 

a sensing circuit coupled to a second terminal of the one of the 
second plurality of diodes. 
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24. The display device of claim 23 wherein the second plurality of 
diodes is capable of sensing light energy that is directed on them from 
outside the display device. 

5 

25. The display device of claim 23 wherein at least some diodes in 
the first plurality of diodes are also in the second plurality of diodes, 

26. The display device of claim 23 wherein the first plurality of 

10 diodes is are arranged in a first row in the display device, and wherein the 
second plurality of diodes is arranged in a second row in the display 
device, the first row being adjacent to the second row. 



27. The display device of claim 23 wherein at least one of the first 
15 plurality of diodes comprises an organic layer. 

28. A method for operating a display system that includes a 
display device having one or more diodes structured to generate 
electroluminescent light, and having one or more diodes structured to 

20 sense light energy shining on them, the method comprising: 

driving the diodes structured to generate light to cause an image to 

be shown on the display device; and 

measuring an amount of light energy shining on the diodes 

structured to sense Ught energy. 



25 



29. The method of claim 28 wherein driving the diodes and 
measuring an amount of light energy occurs simultaneously. 



30. The method of claim 28 wherein driving the diodes occurs 
30 during a first portion of a display cycle and wherein measuring an 
amount of light energy occurs during a second portion of the display 
cycle. 

28 
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31 . The method of claim 30 wherein at least one diode is both 
driven in the first portion of the display cycle and senses light energy in 
the second portion of the display cycle. 

5 

32. The method of claim 28 wherein measuring an amount of 
light energy comprises measuring an amount of light energy generated by 
driving the diodes structured to generate light. 

10 33. The method of claim 28, further comprising: 

adjusting an overall brightness of the display device based on the 
amount of light energy falling on the light sensing diodes. 

34. The method of claim 33 wherein adjusting an overall 

15 brightness of the display comprises modulating a signal used to drive the 
diodes structured to generate light. 

35. The method of claim 28, further comprising: 

sensing an amount of light generated by a particular diode in the 
20 display device; and 

adjusting a driving signal used for driving the particular diode. 

36. The method of claim 35 wherein adjusting a driving signal 
used for driving the particular diode comprises adjusting a driving signal 

25 used for driving the particular diode at several points along a gamma 
curve of the particular diode. 

37. The method of claim 28, further comprising detecting a 
position on the display device of where an external pointing device is 

30 shining. 



29 



wo 03/058588 



PCT/US02/40707 



38. The method of claim 37 wherein the external pointing device 
is a laser pointer. 

39. The method of claim 37, further comprising generating an 

5 image on the display device based on a signal detected from the external 
pointing device. 



30 
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(57) Abstract: A display that includes energy sen- 
sors within the display itself is disclosed. An Or- 
ganic Light Emitting Diode (OLED) can be made 
to operate both as a light emitter and as an energy 
detector. When forward biased with an appropriate 
driving signal, the OLED emits light via electrolu- 
minescence, which can be used to make a portion 
of an image on the display. In another mode, the 
OLED can detect energy by converting incoming 
photons or energy into an electrical signal by the 
photoelectric effect. By operating OLEDs in the 
display in both emissive and sensing modes, energy 
that shines on the display, such as from an outside 
source can be detected at the same time an image 
is shown. Additionally, a display including OLEDs 
can detect light energy generated by the display it- 
self. 
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